-
Notifications
You must be signed in to change notification settings - Fork 56
Multi-image generation CI tests #377
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Multi-image generation CI tests #377
Conversation
Signed-off-by: Mohit Deopujari <[email protected]>
Signed-off-by: Mohit Deopujari <[email protected]>
Signed-off-by: Mohit Deopujari <[email protected]>
Signed-off-by: Mohit Deopujari <[email protected]>
✅ CI PassedAll checks passed successfully against the following vllm commit: |
|
@xuechendi Could you review this PR? single image test doesn't cover test coverage for the sliding_window since seq_len is smaller than 1024(sliding_window size), so we are adding this. I realized that test was added to 27b model, if you want to keep it small model(4b), we can do that as well. Let us know. |
|
/run-gaudi-tests |
|
/run-gaudi-tests |
✅ CI PassedAll checks passed successfully against the following vllm commit: |
|
@xuechendi can this be merged? |
### Test with multimodal-support for multiple images - Current CI test for gemma3 only runs single image per prompt and its input seq_len is less than current sliding_window length (1024). - This new test is designed such that the total input length exceeds the default sliding_window length (1024) to help validate the sliding_window mechanism is actually working or not. --------- Signed-off-by: Mohit Deopujari <[email protected]> Co-authored-by: Michał Kuligowski <[email protected]>
Test with multimodal-support for multiple images